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Abstract — A reduced-rank framework with set-membership 
filtering (SMF) techniques is presented for adaptive beamforming 
problems encountered in radar systems. We develop and analyze 
stochastic gradient (SG) and recursive least squares (RLS)-type 
adaptive algorithms, which achieve an enhanced convergence and 
tracking performance with low computational cost as compared 
to existing techniques. Simulations show that the proposed 
algorithms have a superior performance to prior methods, while 
the complexity is lower. 

Index Terms — Adaptive beamforming, antenna arrays, 
reduced-rank techniques, low-complexity algorithms. 



I. Introduction 

With the development of array signal processing techniques, 
beamforming has long been investigated for numerous applica- 
tions in radar, sonar, seismology, and wireless communications 
JD, 0- The most well-known beamforming technique is 
the optimal linearly constrained minimum variance (LCMV) 
beamformer 0, J4]. It exploits the second-order statistics of 
the received vector to minimize the array output power while 
constraining the array response in the direction of the signal 
of interest (SOI) to be constant. In general, the constraint 
corresponds to prior knowledge of the direction of arrival 
(DOA) of the SOI. 

Many adaptive algorithms have been reported for the im- 
plementation of the LCMV beamformer, ranging from the 
low-complexity stochastic gradient (SG) algorithm to the more 
complex recursive least squares (RLS) algorithm [5 1. Accord- 
ing to the parameter estimation strategy of the algorithm, 
the SG and RLS algorithms can be included in the class 
of full -rank processing techniques liTTl . The full-rank adaptive 
algorithms usually require a large number of snapshots to 
reach the steady-state when the number of elements in the 
beamformer is large, and the resulting convergence speed 
reduces significantly. In dynamic scenarios (e.g., when inter- 
ferers enter or exit a given system), filters with many elements 
show a poor tracking performance when dealing with signals 
embedded in interference and noise. These situations are quite 
relevant in defence systems such as radar. Other strategies for 
interference suppression coming from the antenna community 
include the recent work by Massa et al. J6) that introduces 
a dynamic thinning strategy, the work by D'Urso et al. Q 
that considers a hybrid optimization procedure that adjusts 
both clustering into subarrays and excitations of the subarrays, 
the contribution of Haupt J8) which uses subarrays a hybrid 
genetic algorithm to optimize the size of the subarrays their 
weights, the method of Haupt and Aten J9) which employs a 
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genetic algorithm to optimize the orientation of each dipole 
in an array, and the technique by Haupt et al. flOl that uses 
partial adaptation of the beamforming weights. 

These problems motivate us to investigate a more effective 
signal processing approach known as reduced-rank signal 
processing, which allows a designer to address the drawbacks 
of full-rank algorithms. The idea is to employ a transformation 
matrix that projects the received signal onto a lower dimen- 
sional subspace, and then the reduced-rank filter optimization 
occurs within this subspace. This has the advantage of improv- 
ing the convergence and tracking performance. The advantage 
is more obvious when the number of sensor elements in 
the array is large. Well-known reduced-rank schemes include 
the multistage Wiener filter (MSWF) |[T2]-|[I3, the auxiliary 
vector filtering (AVF) |[T6l . |[T7l the joint iterative optimization 
(JIO) Ifl8l - ll22l and the joint interpolation, decimation and 
filtering (JIDF)-based approaches ll23l - ll25l . They employ 
different procedures to construct the transformation matrix 
and to estimate the parameters. A common problem of these 
reduced-rank schemes is the relatively high computational load 
required to compute the transformation matrix. 

An efficient approach to reducing the computational com- 
plexity is to employ a set-membership filtering (SMF) tech- 
nique l26l . l27l for the beamformer design. The SMF specifies 
a predetermined bound on the magnitude of the estimation 
error or the array output and performs data-selective updates to 
estimate the parameters. It involves two steps: 1) information 
evaluation (depending on the predetermined bound) and 2) 
parameter update (depending on step 1)). If the parameter 
update does not occur frequently, and the information evalua- 
tion does not require much complexity, the overall complexity 
can be substantially reduced. The well-known SMF algorithms 
include the SG-based algorithms in ll26l and the RLS-based 
algorithms in [27], 11281 . These algorithms are examples of 
the application of the SMF technique in the full-rank signal 
processing context. 

The objective of this paper is to introduce a constrained 
reduced-rank framework and algorithms for achieving a supe- 
rior convergence and tracking performance with significantly 
lower computational cost comparable with their reduced-rank 
counterparts. We consider reduced-rank LCMV designs using 
the SMF concept that imposes a bounded constraint on the 
array output and the JIO strategy. The joint optimization of 
the transformation matrix and the reduced-rank filter are then 
performed for beamforming. The reduced-rank parameters 
only update if the bounded constraint cannot be satisfied. 
This partial update plays a positive role in increasing the 
convergence speed. The updated parameters belong to a set of 
feasible solutions. Considering the fact that the predetermined 
bound degrades the performance of the SMF technique due 
to the lack of knowledge of the environment, we utilize a 



2 



parameter-dependent time-varying bound instead to guarantee 
a good performance. Related work can be found in ll29l , 11301 
but only focuses on the full-rank signal processing context. 
In this paper, we introduce this technique into the reduced- 
rank signal processing context. The proposed framework, 
referred here as JIO-SM, inherits the positive features of 
the reduced-rank JIO schemes that jointly and iteratively 
exchange information between the transformation matrix and 
the reduced-rank filter, and performs beamforming using the 
SMF data-selective updates. We propose constrained reduced- 
rank SG-based and RLS-based adaptive algorithms, namely, 
JIO-SM-SG and JIO-SM-RLS, for the design of the proposed 
beamformer. A discussion on the properties of the developed 
algorithms is provided. Specifically, a complexity comparison 
is presented to show the advantages of the proposed algorithms 
over their existing counterparts. A mean-squared error (MSE) 
expression to predict the performance of the proposed JIO- 
SM-SG algorithm is derived. We also analyze the properties 
of the optimization problem by employing the SMF constraint. 
Simulations are provided to show the performance of the 
proposed and existing algorithms. 

The remainder of this paper is organized as follows: we 
outline a system model for beamforming in Section II. Based 
on this model, the full-rank and the reduced-rank LCMV 
beamformer are reviewed. The novel reduced-rank framework 
based on the JIO scheme and the SMF technique is presented 
in Section III, and the proposed adaptive algorithms are 
detailed in Section IV. A complexity study and the related 
analyses of the proposed algorithms are carried out in Section 

V. Simulation results are provided and discussed in Section 

VI, and conclusions are drawn in Section VII. 

II. System Model and LCMV Beamformer Design 

In this section, we describe a system model to express the 
array received vector. Based on this model, the full-rank and 
the reduced-rank LCMV beamformers are introduced. 



A. System Model 

Let us suppose that q narrowband signals impinge on a 
uniform linear array (ULA) of m (m > q) sensor elements. 
The sources are assumed to be in the far field with DOAs 
6*o,. . . ,9 q -i- The received vector x G C mXl can be modeled 

as 



A{0)s 



(1) 



where 6 = [9 , . . . , 9 q ^i] T G K 9Xl is the vector with 
the signals' DOAs, A{6) = [a(0 o ), ■ ■ ■ , a(0 9 _i)] G C mxq 
comprises the normalized signal steering vectors a(9k) = 



[l,e 



-2-jrj j^cos 



'Y G C mxl , {k 



0, . . .,q — 1), where A c is the wavelength and u (u = A c /2 
in general) is the inter-element distance of the ULA. To 
avoid mathematical ambiguities, the steering vectors a(9k) are 
assumed to be linearly independent, s G C qxl is the source 
data vector, n G C mxl is the noise vector, which is assumed 
to be a zero-mean spatially and Gaussian process, and (-) T 
stands for transpose. 



B. Full-rank LCMV Beamformer Design 

The full-rank LCMV beamformer design is equivalent to 
determining a set of filter parameters w = [w\, . . . ,w m ] T G 
C mxl that provide the array output y = w H x, where 
(■) H represents Hermitian transpose. The filter parameters are 
calculated by solving the following optimization problem: 

minimize E[|y| 2 ] = E[\w H x\ 2 } 7 subject to w H a(9 ) = 7, 

(2) 

where a(9o) is the full -rank steering vector of the SOI and 7 is 
a constant. The objective of (O is to minimize the array output 
power while maintaining the contribution from 9q constant. 
The solution of the LCMV optimization problem is 



w opt = 



lR- 1 a{9 ) 
a H (9 Q )R- 1 a(9 Q y 



(3) 



where R = K[xx H ] G C mxm is the received data covariance 
matrix. The filter w can be estimated in an adaptive way 
via SG or RLS algorithms, where R is calculated by its 
sample estimate. However, their convergence and tracking 
performance depends on the filter length in, and degrades 
when m is large J5), |20l . 

C. Reduced-rank LCMV Beamformer Design 

An important feature of the reduced-rank schemes is to con- 
struct a transformation matrix T r G C mxr that performs the 
dimensionality reduction that projects the full-rank received 
vector onto a lower dimension, which is given by 



tJC — 'J. ' QC , 



(4) 



where x denotes the reduced-rank received vector and r(l < 
r < m) is the rank. In what follows, all r-dimensional 
quantities are denoted with a "bar". 

The reduced-rank LCMV beamformer estimates the param- 
eters w = [wi, . . . , w r ] T G C rxl to generate the array output 
y = w H x. The reduced-rank filter is designed by solving the 
optimization problem: 

minimize E[|y 
subject to w H a{9{ 



\w H x\ 2 ] 



1, 



(5) 



where cl(9q) = T^a(9o) is the reduced-rank steering vector 
with respect to the SOI. The solution of the reduced-rank 
LCMV optimization problem is 



^opt 



where R 



E[xx H ] 



jR~ a{9 ) 
d H (9 Q )R- 1 a(9 y 

T"RT r G C rx ' 



(6) 



r is the reduced- 
rank data covariance matrix. The MSWF [14], |Q~5], the AVF 
lfl6l . and the JIO lfl8l are effective reduced-rank schemes 
to construct the transformation matrix aided by SG-based 
or RLS-based adaptive algorithms for parameter estimation. 
However, there is a number of problems and limitations 
with the existing techniques. The computational complexity 
of algorithms dealing with a large number of parameters 
can be substantial. It is difficult to predetermine the step 
size or the forgetting factor values to achieve a satisfactory 
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tradeoff between fast convergence and misadjustment [2 |. The 
RLS algorithm present problems with numerical stability and 
divergence Q. Furthermore, the computational cost is high if 
the transformation matrix has to be updated for each snapshot. 

III. Proposed JIO-SM Framework 

In order to address some of the problems stated in Section 
II, we introduce a new constrained reduced-rank framework 
to address them by combining the SMF techniques with 
the reduced-rank JIO scheme, as depicted in Fig. [TJ In this 
structure, the transformation matrix is constructed using a bank 
of r full-rank filters tj = [h i3 ■, t 2 j, ■ . ■ , t m j] T <E C mxl , 
(j = 1, ...,r), as given by T r = [t 1 ,t 2: ■ . ■ ,t r }. The 
transformation matrix processes the received vector x for 
reducing the dimension, and retains the key information of the 
original signal in the generated reduced-rank received vector 
x. The reduced-rank filter w then computes the output y. 











Transformation Matrix 


X 




Reduced-Rank Filter 


T r 




w 



If \y\ 2 > S 2 then update 



SMF Check 

\y\ 2 < s 2 



Adaptive Algorithm 



If \y\ — " then do not update 



Fig. 1. Proposed reduced-rank JIO-SM structure. 

For the IIO scheme, the reduced-rank adaptive algorithms 
lfl8l are developed to update T r and w with respect to each 
time instant "i". In the proposed JIO-SM structure, the SMF 
check is embedded to specify a time-varying bound S (with 
respect to i) on the amplitude of the array output y. The 
time-varying bound is related to the previous transformation 
matrix and the reduced-rank weight vector. The parameter 
update is only performed if the constraint on the bound 
\y\ < |<5| 2 cannot be satisfied. At each time instant, some 
valid pairs {T r ,w} are consistent with the bound. Therefore, 
the solution to the proposed JIO-SM scheme is a set in the 
parameter space. Some pairs of {T r ,w} even satisfy the 
constrained condition with respect to different received vectors 
for different "i". Thus, the proposed scheme only takes the 
data-selective updates and ensures all the updated pairs satisfy 
the constraint for the current time instant. In comparison, 
the conventional full-rank or reduced-rank filtering schemes 
only provide a point estimate with respect to the received 
vector for each time instant. This estimate may not satisfy the 
condition with respect to other received vectors (at least before 
the algorithm achieves the steady-state). Compared with the 
existing SMF techniques Il26ll - ll28l . the proposed scheme takes 
both T r and w into consideration with respect to the bounded 
constraint in order to promote an exchange of information 
between them. This procedure ensures the key information of 
the original signal to be utilized more effectively. 



Let Hi denote the set containing all the pairs of {T r ,w} 
for which the associated array output at time instant i is upper 
bounded in magnitude by 6, which is 



Hi = {T r g C mxr ,w € 



\y\ 



< 



(7) 



where Hi is bounded by a set of hyperplanes that correspond 
to the pairs of {T r ,w}. The set Hi is referred to as the 
constraint set. We then define the exact feasibility set Qi as 
the intersection of the constraint sets over the time instants 
I = 1, . . . , i, which is given by 

i 

@«=n Hi ' (8) 

i=1 (s ,x)es 

where sq is the SOI and S is the set including all possible data 
pairs {sq, x}. The aim of ([8]) is to develop adaptive algorithms 
that update the parameters such that they will always remain 
within the feasibility set. In theory, should encompass all the 
pairs of solutions {T r , w} that satisfy the bounded constraint 
until i — > oo. In practice, S cannot be traversed all over. It 
implies that a larger space of the data pairs provided by the 
observations leads to a smaller feasibility set. Thus, as the 
number of data pairs (or "i") increases, there are fewer pairs 
of {T r ,w} that can be found to satisfy the constraint. Under 
this condition, we define the membership set 'J'i = H/=i % as 
the practical set of the proposed JIO-SM scheme. It is obvious 
that G is a limiting set of ^. These two sets will be equal if 
the data pairs traverse S completely. 

The proposed JIO-SM framework introduces the principle 
of the SMF technique into the constrained reduced-rank signal 
processing for reducing the computational complexity. The 
reduced number of parameters and data-selective updates 
reduce the complexity. It should be remarked that, due to the 
time-varying nature of many practical environments, the time- 
varying bound should be selected appropriately to account for 
the characteristics of the environment. Moreover, the use of an 
appropriate bound will lead to highly effective variable step- 
sizes and forgetting factors for the SG-based and RLS-based 
algorithms, respectively, an increased convergence speed and 
improved tracking ability. We will detail their relations next. 

IV. Proposed JIO-SM Adaptive Algorithms 

We derive SG-based and RLS-based adaptive algorithms for 
the proposed JIO-SM scheme. They are developed according 
to the reduced-rank LCMV optimization problem that incor- 
porates the time-varying bounded constraint on the amplitude 
of the array output. The problem is defined as: 



minimize 



w 



H T*x\ 2 ]=w H Rw 



(9) 



subject to w H a{9 ) = 7 and \w h T"x\ 2 = S 2 , 

The optimization problem in (O is a function of T r and 
w. In order to obtain a solution, we employ an alternating 
optimization strategy, which is equivalent to fixing w and 
computing T r with a suitable adaptive algorithm followed by 
another step with T r fixed and the use of another adaptive 
algorithm to adjust w. This will be pursued in what follows 
with constrained SG and RLS-type algorithms for which a 
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time-varying bound S[i] determines a set of solutions {T r , w} 
within the constraint set T-L at each time instant. Regarding 
the convergence of this type of strategy, a general alternating 
optimization strategy has been shown in ll35l to converge to the 
global minimum. In our studies, problems with local minima 
have not been found although a proof of convergence is left 
for future work. 



A. Proposed JIO-SM-SG Algorithm 

In order to solve the optimization problem by the SG-based 
adaptive algorithm, we employ the Lagrange multiplier method 
to transform the constrained problem into an unconstrained 
one, which is 

J(T r , w) = E[w H T?xx H T r w] + 2r 1 m[w H d(0 o ) - 7] , 

(10) 

where 77 is the Lagrange multiplier and 9t[-] selects the real 
part of the quantity. It should be remarked that the bounded 
constraint \w H T^x\' 2 = 5 2 is not included in (TTOb . This is 
because a point estimate can be obtained from ( fTOb whereas 
the bounded constraint determines a set of {T r ,w} (also 
including the solution from (fTUli). We use the constraint on 
the steering vector of the SOI to obtain a solution and employ 
the constraint to expand it to a hyperplane (multiple solutions). 

Assuming w is known, taking the instantaneous gradient 
of ( [Tol l with respect to TV, equating it to a zero matrix and 
solving for 77, we have 



and 



TS + 1) = T r (i) » T y*(i) [I - 

(11) 

where fix is the step size value for the update of the trans- 
formation matrix and I is the corresponding identity matrix. 
Note that we use the adaptive version to perform parameter 
estimation and thus we include "i" in the related quantities. 

Assuming T r is known, computing the instantaneous gra- 
dient of ([Tol l with respect to w, equating it a null vector and 
solving for 77, we obtain 

-c , i\ -c\ *c\\r a(9 )a H (do), 

w(i + 1) = w(i) - nay (1) [I - _ H \x(i) 7 (12) 

a (U )a{Vo) 

where fj,w is the step size value for the update of the reduced- 
rank weight vector. 

The SMF technique provides an effective way to adjust 
the step size values and to improve the performance. SMF 
algorithms with the predetermined bounds were reported in 
l27l . However, a predetermined bound always has the risk of 
underbounding (the bound is smaller than the actual one) or 
overbounding (the bound is larger than the actual one). Instead 
of the predetermined bound, we use a time-varying bound 
in the proposed JIO-SM-SG algorithm to adjust the step size 
values for offering a good tradeoff between the convergence 
and the misadjustment, which are 



Hi) 



Hw(i) 







if \y(i)\ 2 > 5\i) 



otherwise, 



(14) 

where the derivations are provided in the appendix. 

The proposed JIO-SM-SG algorithm consists of the equa- 
tions ([TTli-(fl4li, where the expression of the time-varying 
bound S(i) will be addressed later in this section. From (ITU 
and ( TT2b . the transformation matrix and the reduced-rank 
filter depend on each other, which provides a joint iterative 
exchange to utilize the key information of the reduced-rank 
received vector more effectively, and thus leads to an improved 
performance. The SMF technique with the time-varying bound 
is employed to determine a set of estimates {T r (i),w(i)} 
that satisfy the bounded constraint (constraint set Hi). The 
computational complexity is reduced significantly due to the 
data-selective updates. The proposed algorithm is more robust 
to dynamic scenarios compared to their SG-based counterparts. 



B. Proposed JIO-SM-RLS Algorithm 

The constrained optimization problem in ((9) can be trans- 
formed into an unconstrained least squares (LS) one by the 
Lagrange multipliers. The Lagrangian is given by 

i-l 

J(T r ,w) = ^X 1 ~\i)w H {i)T" (i)x(l)x H [l)T r (i)w{i) 
1=1 

+ 2\- L {i)<R[\w H (i)T? (i)x{i)\ 2 - 8 2 (i)} + 2\ 2 <K[w H ' (i)d(8 ) - 7] , 

(15) 

where Xi(i) plays the role of the forgetting factor and the 
Lagrange multiplier with respect to the bounded constraint. 
This coefficient is helpful to estimate the received covariance 
matrix in a recursive form and utilize the matrix inversion 
lemma. The coefficient A2 is another Lagrange multiplier for 
the constraint on the steering vector of the SOI. 

Assuming w(i — 1) is known, taking the gradient of T r (i) 
with respect to (TT~5T > and employing the matrix inversion lemma 
(0, we have 



T r (i) = 



yP(i)a(6 



w H (i - 1) 



a H (9 )P(i)a(9 ) \\w(i-l) 



(16) 



where R(i) = R(i - 1) + \i(i)x(i)x H (i) (note that this 
expression is given under an assumption that X\(i) is close to 1 
in order to make it according with the setting of the forgetting 
factor |5;|, so as R(i) in the following) and P(i) = 
is calculated in a recursive form 



k(i) 



P(i - l)x{i) 



(17) 



Mt(«) 



Hi) 





m H (i)w(i)x H (i)[I-a{8o)a H (9o)]x(i) 





if\y(i)\ 2 > S 2 (i) 
otherwise 
(13) 



1 + X 1 (i)x H (i)P(i - l)x(i) 
P{i) = P{i - 1) - Ai(i)fc(i)a; H (i)P(i - 1). (18) 

The derivation of (TToT l is given in the appendix. 

Given the assumptions that T r (i) is known and Ai(i) — > 1, 
computing the gradient of w(i) with respect to (fT5T l. we get 



w(i) 



a H (6 )P(i)a(6 Q y 



(19) 



5 



where R(i) = R(i-l) + \i(i)x(i)x H (i) and P(i) = R (i) 
is calculated by 

k(i) 



P(i - l)x(i) 



P(i) 



1 + Xi{i)x H {i)P{i - l)x{i) 
P(i - 1) - \i(i)k(i)x H (i)P(i - 1). 



(20) 



(21) 



The coefficient Ai(i) is important to the updates of TJi_ 
and w(i). In order to obtain its expression, we substitute (Q~6 
and ( TT9b into the constraint in (0, which leads to 



V. Analysis 

In this section, we give a complexity analysis of the 
proposed algorithms and compare them with the existing 
algorithms. An MSE expression to predict the performance 
of the proposed JIO-SM-SG algorithm is derived. We also 
give the stability analysis and study the properties of the 
optimization problem. 



Ai(i) = 



a, H {e )P(i-l)[&(i)a,(e )- 1 2 K(i)\ 
a H {B )k{i)tE H (i)P(i-l)[S(i)a{e )-j 2 a!(i)] 





if \y(i)\ 2 >s 2 (i 

otherwise, 
(22) 



It is clear that involves the time-varying bound, the 

full-rank received vector and the related quantities. It provides 
a way to track the changes of S(i) and control the weighting 
of P(i). The proposed JIO-SM-RLS algorithm corresponds to 
equations (IT6l>-(l2~2l>. where p and g are small positive values for 
regularization, and T r (0) and w(0) are used for initialization. 
The joint iterative exchange of information between T r (i) and 
w(i) is achieved from their update equations. The coefficient 
is calculated only if the constraint cannot be satisfied, 
so as the parameters' update. All the pairs of {T r (i),w(i)} 
ensuring the bounded constraint until time instant i are in 
the feasibility set Qi. The proposed JIO-SM-RLS algorithm 
has better performance and lower computational cost than the 
existing reduced-rank algorithms. 

C. Time-varying Bound 

The time-varying bound 5(i) is a single coefficient to check 
if the parameter update is earned out or not. In other words, 
it is an important criterion to measure the quality of the 
parameters that could be included in the feasibility set G^. 
Besides, it is better if 8(i) could reflect the characteristics 
(time-varying nature) of the environment since it benefits the 
estimation and the tracking of the proposed algorithms. From 
© and ((H), S(i) cannot be chosen too stringent for avoiding 
an empty 6^ with respect to a given model space of interest. 
Here, we introduce a parameter dependent bound (PDB) that 
is similar to the work reported in ||29l but which considers 
both T r (i) and w(i). The proposed time-varying bound is 



<*(») = 05(i - 1) + (1 - PWa\\T r (i)w{i)\\*al{i), (23) 

where (3 is a positive value close to 1 (/? = 0.99 in general), 
which is set to guarantee an proper time-averaged estimate of 
the evolutions of the weight vector w(i), a(a > 1) is a tuning 
coefficient that impacts the update rate and the convergence, 
and <5f>(i) is an estimate of the noise power, which is assumed 
to be known at the receiver. The term ||T r (i)'u;(i)|| 2 (T^(i) 
is the variance of the inner product of the weight vector 
with the noise that provides information on the evolution of 
T r (i) and w(i). It formulates a relation between the estimated 
parameters and the environmental coefficients. This kind of 
update provides a smoother evolution of the weight vector 
trajectory and thus avoids too high or low values of the squared 
norm of the weight vector. As S(i) is chosen properly, it 
ensures that the feasibility set 0; is nonempty and any point 
in it is a valid estimate with respect to the constraint set Hi. 



A. Complexity Analysis 



In 1311 . the computational complexity required for the 
existing full-rank and reduced-rank adaptive algorithms for 
each time instant (snapshot) is reported. Here, due to the data- 
selective updates, we calculate the complexity for the whole 
number of snapshots N to provide a fair comparison. The 
computational cost is measured in terms of the number of 
complex arithmetic operations, i.e., additions and multiplica- 
tions. The results are listed in TableQ] where r is the number of 
rank, m is the number of sensor elements, N is the number 
of snapshots, and r (0 < r < 1) is the update rate for the 
adaptive algorithms with the SMF technique, which is obtained 
by finding the number of updates for a fixed N. 

From TableQ] we find that the complexity of the existing and 
proposed algorithms depends more on N and m (especially 
for large arrays) since they are much larger than r, which is 
often selected around a small range. The value of the update 
rate r impacts the complexity significantly. Specifically, for a 
small value of r, the complexity of the algorithms with the 
SMF technique is much lower than their counterparts with 
100% updates since the parameter estimation procedures only 
perform with a small number of snapshots. For a very large r 
(e.g., t = 1), the SM-based algorithm is a little more complex 
than their counterparts due to the calculations of the time- 
varying bound, step size values (for the SG-based algorithms), 
and the forgetting factor (for the RLS-based algorithms). In 
most cases, it only needs a small number of updates to achieve 
parameter estimation and thus reduces the computational cost. 

Fig. |2]provides a more direct way to illustrate the complex- 
ity requirements for the algorithms compared. It shows the 
complexity in terms of additions and multiplications versus the 
number of sensor elements m. Note that the values of r and 
r are different with respect to different algorithms, which are 
set to make a good tradeoff between the output performance 
and the complexity. Their specific values are given in the 
figure. It is clear that the reduced-rank adaptive algorithms are 
more complex than the full-rank ones due to the generation 
of the transformation matrix. The adaptive algorithms with 
the SMF technique save the computational cost significantly. 
The proposed JIO-SM-SG and JIO-SM-RLS algorithms have 
a complexity slightly higher than their full-rank algorithms 
but much lower than the existing reduced-rank methods. As 
N or/and m increase, this advantage is more obvious. It is 
worth mentioning that the complexity reduction due to the 
data-selective updates does not degrade the performance. This 
will be shown in the simulation results. 
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TABLE I 

Computational complexity of algorithms 



Algorithm Additions Multiplications 
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Fig. 2. Complexity in terms of arithmetic operations versus the number of 
sensor elements m. 



B. Stability Analysis 

In order to establish conditions for the stability of the 
proposed JIO-SM-SG algorithm, we define e-r(i) = T r (i) — 
TV j0p t and e. a (i) = w(i) - w opt with IY opt and w opt being 
the optimal solutions of the transformation matrix and the 
reduced-rank filter, respectively. The expression of T r opt can 
be obtained by taking the gradient of ( TTcTb with respect to T r , 

i.e., 2Y j0p , = a « 7 *^°l ^j™:^ , where w opt has been given 
in ©. By substituting dllb and ( fl2b into er(i) and e @ (i), 
respectively, and rearranging the terms, we have 

er(i + 1) = Ti(i)e T (i) - fx T (i)T 2 (i) + ^t{i)T 3 {i), (24) 

e m (i + 1) = Wxii)^) - n*,{i)W 2 (i), (25) 

where 

Ti(i) = I ~ l*W ~ g)S M»>*(» 

T 3« = [I- ^^ ]x{i)x H (i)[(l-w H (i)w opt )T r {i)- 
I-^(i)[I- ^^ ]x(i)x H (i); 

a(8 )a H (go) 



r,optJi 

Wi(i) 

W 2 (z) = [I- ^^ ]x(i)x H (i)w op , 

Since we are dealing with a joint optimization procedure, 
both the transformation matrix and the reduced-rank filter 



have to be considered jointly. Besides, the time- varying bound 
should be investigated. By substituting ( fT3T > and (TBI) into (1241) 
and (1251 . respectively, and taking expectations, we get 



"E[e T (« - 


hi)]" 




'Ui " 




'E[e T (i)}~ 




Vi" 


_E[e tD (z - 






C7 2 _ 




E[e ffi (i)]_ 


+ 


v 2 



(26) 



where 



C/ 2 



v x = 



IWJ] . 



||™(i)|| 2 a:»(i)[J 

fl- 



th — 



y(i)l . 







H (a Q )a(fl ) 



(e )o(e ) J 
^]S(i)x H (i) 



.i* 



i«(8 )a(8 ) J 
T 2 (i)+T 3 (i)] 



(0 



2 cc»(i)[/ 



From (126b , it implies that the stability of the proposed 
JIO-SM-SG algorithm depends on the spectral radius of 
U = diag[(7i, U2\- The step size values should satisfy the 
condition that the eigenvalues of U H U are less than one for 
convergence. The variable step size values calculated by dT3b 
and ( TBI follow this condition with the bounded constraint. 
Unlike the stability analysis of existing adaptive algorithms, 
the terms in the proposed algorithm are more involved and 
depend on each other as evidenced by the equations in U, 
Vi and V2- 

C. Prediction of The Trend of MSE 

In this part, we derive expressions to predict the trend of the 
MSE for the proposed JIO-SM-SG algorithm. The following 
analysis begins with the conventional MSE analysis of ||5l 
and then involves the novel parameters T r (i) and w(i) due 
to the joint optimization property. The data-selective updates 
of the SMF technique is also considered in the analysis by 
introducing a new coefficient P e (i) in the update equations. 

Let us define the the estimation error at time instant i to be 



e(i) = d (i) - y(i) = e (i) - (i)x(i), 



(27) 



where do(i) denotes the transmitted data of the desired user, 
e w (i) = w(i) — w opt with w opt being the optimal weight 
solution, and e (i) = do(i) — w^ t x(i). The filter w(i) = 
T r (i)w(i) with m parameters is the 7--rank approximation of 
a full-rank filter obtained with an inverse transformation [l20| 
processed by T r (i). 
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The MSE following the time instant i is given by 

JmseW -E[|e(z)| 2 ] 

= J min +E[e%(i)Re w {i)] 

= Jmin + cr^tr{cOv[e u ,(l)]} 



(28) 



where J m j n is the minimum MSE (MMSE) produced by the 
optimal LCMV solution and cr^tr{cov[e u , (i)]} denotes the 
excess MSE (EMSE) with a 2 = B^+B 2 bf+. . .+B 2 _ 1 b 2 _ 1 
being the summed variance of the transmitted data and Bk 
(k = 0, . . . , q — 1) being the amplitude. Assuming dk is 
independent and identically distributed (i.i.d.), the MMSE can 
be expressed by 

Jmin -E[|e (i)| 2 ] 

= E[|d (i)| 2 ] - w^ pt a(6 ) - a H (6 )w opt + w^ pt Rw opt . 

(29) 

Considering the inverse transformation, the weight error vector 
becomes, 



e w (i) = T r (i)w(i) 



r, opt ^ opt 



e T {i)e a (i) + T rfiVt e a (i) + e T (i)w opt . 



(30) 



To provide further analysis, we use (Q~T) and (TTZt and consider 
the data-selective updates of the SMF technique given by 

T r (i+1) = T r (i)-P4i)t, T (i)y*(i) aJ (i)« H (t), 

(3D 



tB(i + 1) = «>(i) - P e {i)^(j)y*{i)[l - a Vf a "V°h x(i), 

a"{0o)a(0 o )-' 

(32) 

where /j,t(i) and /^(i) are the variable step size values follow- 
ing the time-varying bound, and P e (i) is a coefficient modeling 
the probability of updating the filter parameters with respect 
to a given time instant i, namely, P e (i) = P[\y(i)\ 2 > S 2 (i)}. 
Note that P e (i) is same for d3Tb and d32l since T r (i) and 
w(i) depend on each other and update jointly. 

Substituting (l3TT l and (l32l into (f30t and making some 
rearrangements, we have 

e w {i + 1) =e w (i) - P e (i)/j, T (i)y*(i)G r (i)w(i) 

-P e (i)Vw(i)y*(i)T r (i)g(i) (33) 
+ P 2 (i)HT(i)^(i)ly*(i)?G r (i)g(i), 

where G r (i) = [I - a(8 )a H (6 )]x(i)w H (i), and g(i) = 

i 1 - a^s(£) ] a (0- B y usin 8 and GS and "PPlying 
= w H (i)x(i) to (l30b . we get 

e„(i + 1) = [/ - V(i)]e„,(i) - V(i)w op t + T(i)G r (i)g(i), 

(34) 

where 

- P C^n - ^ u G r (i)w(i)x H (i) T r (i)g{i) X H {i) v 
v — r e ^[i |^(iJ[JLto»(i)Gj?(i)B(i) " r 8 H (i)g(i) J' 



'( l ) = p e 2 Wr«] 2 - 7r7 



[1- 



£W 12 



w H (i)G» (i)x(i)x H (i)g{i) ■ 

The last step is to give a P e (i) in order to provide good 
estimates. In l32l , a fixed probability that approximates the 
update rate of the parameters is introduced. Here, we use a 



modified version and involve the time-varying bound in our 
time-varying probability, which is 



Pe{i) = 2Q( 



(35) 



where Q(-) is the complementary Gaussian cumulative distri- 
bution given by Q(x) = J™ -J=e _t " / 2 dt, and P mm is prior 
information about the minimum update rate for the proposed 
algorithm to reach a relatively high performance. Both P e (i) 
and P m i„ are different with respect to different N and reflect 
the data-selective updating behavior as N increases. The term 
Pmin is a certain value if the number of snapshots is fixed. 

The weight error vector can be calculated via its updating 
equation d34j. The MSE value of the proposed JIO-SM- 
SG algorithm at a given time instant i can be obtained by 
substituting (l34l into (T28l l. which is 

+ o- 2 tr{cov{ [I - V(i)]e w (i) - V(i)t»opt + r(i)G r (i)fl(i)}} 

(36) 

This analysis provides a means to predict the trend of the MSE 
performance of the proposed algorithm. In the next section, we 
use the simulation result to verify the validity of the analysis. 

D. Analysis of The Optimization Problem 

In this part, we provide an analysis based on the optimiza- 
tion problem in © and show a condition that allows the 
designer to avoid local minima associated with the proposed 
optimization problem. The analysis also considers the bounded 
constraint and the constraint on the steering vector of the SOI 
to illustrate the properties of the problem. Our analysis starts 
from the transformation of the array output y(i) in a more 
convenient form and then substitutes its expression into the 
constrained optimization problem to render the analysis. For 
simplicity, we drop the time instant i in the quantities. 

From ((T), the array output can be written as: 

9-1 



y = w H T?{Y,aWk)sk + n} 



k=0 
q—1 r 



(37) 



k=0 j=l j=l 



where Sk £ C xr is a diagonal matrix with all its main diag- 
onal entries equal to the transmitted data of the fcth user, i.e., 



Sk, t< e 



is the jth column vector of the transformation 



matrix TV, and v 2 G c rxl is a vector containing a 1 in the jth 
position and zeros elsewhere. In order to proceed, we define 









;Sn = 








;/* = 


w* 


5 J n 


W* 


s k 










rriT „* 
± r a k_ 





(38) 



where § fe e £ 2rx2r , S„ € C 2rx2r are the signal matrix 
containing the transmitted signal of the fcth user and the noise 
matrix containing n, respectively, and f k € C 2rxl and f n £ 
C 2rxl are the parameter vector containing the steering vector 
of the fcth user and the noise vector related to n, respectively. 
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According to (l38l l, the array output can be expressed by 

9-1 

y = J2f"^f k + f^nf n , (39) 

k=Q 

where we notice that, if k = 0, it has fo^afa = 
= 7.s , which is based on the constraint 
on the steering vector of the SOI in (0. The expression in 
( |39| > involves this constraint in the array output and thus will 
simplify the derivation when substituting into the optimization 
problem. This is also the reason why we use ((39) instead of 
y = w H T^x for the analysis. 

Before taking the analysis further, we use two assumptions. 
First, the signals are assumed to be transmitted indepen- 
dently. Second, we consider a noise free case 11331 or a 
sufficiently high signal-to-noise ratio (SNR) condition. Under 
these assumptions, using the Lagrange multiplier method, the 
optimization problem in © can be written as 

J(T r , w)=E[\y\ 2 ]+2Xm[\y\ 2 -6 2 } 
9-1 

t=t (40) 

q-lq-l 

+ 2\m[J2 E /f s fc / fc /Psf /, - 5% 

k=0 1=0 

where the constraint on the steering vector of the SOI is not 
included since it has been enclosed in d39l >. 

In order to evaluate the property of (1451 . we can verify 
if the Hessian matrix Hq f34l with respect to f Q of the 
desired user is positive semi-definite for all nonzero vector 
u with u H HqU > 0. Computing the Hessian of the above 
optimization problem for the desired user we obtain 

_ d dJ 

° dtfdf (41) 
= E[H i + if 02] + 2A9t[ff i + H02 + H 03 ] , 

where 

Hoi = ^afofa^a + &o fofo 

H02 = f Sq fqSo + f o §0/0^?; 

H 03 = ELi /fc Sf/ fc S fc + E?=i /PSz/iSf. According to 
the constraint, i?02 = 291[7*SqSo]. From (l4TT i. Hqi yields a 
positive semi-definite matrix, while if 03 is an undetermined 
term. Thus, for avoiding the local minima associated with the 
optimization problem, a sufficient condition is to guarantee 

H' = E[H 02 ] + 2\9\{H Q2 + H Q5 ] , (42) 

to be positive semi-definite, i.e., u H H' u > 0. This task can 
be achieved by selecting an appropriate Lagrange multiplier 
A. For the Hessian matrix with respect to the other users, H & 
(k = 1, . . . , q — 1), we could use the same way to avoid the 
local minima of the optimization problem. 

VI. Simulations 

In this section, we evaluate the performance of the proposed 
JIO-SM-SG and JIO-SM-RLS adaptive algorithms for design- 
ing LCMV beamformers and compare them with existing algo- 
rithms. Specifically, we compare the proposed algorithms with 



the full-rank (FR) SG and RLS algorithms [5 1 with/without the 
SMF technique, and the reduced-rank algorithms based on the 
MSWF UH and the AVF fT6[ techniques. In all simulations, 
we assume that there is one desired user in the system and 
the related DOA is known beforehand by the receiver. All 
the results are averaged by 1000 runs. The input signal-to- 
interference ratio (SIR) is SIR=— 20 dB. We consider the 
binary phase shift keying (BPSK) modulation scheme and set 
7 = 1 for the studied algorithms. Simulations are performed 
with a ULA containing m = 64 sensor elements with half- 
wavelength interelement spacing. We consider m large in 
order to show their advantages of the proposed algorithms in 
terms of performance and computational complexity when the 
number of elements in the beamformer is large. 

In Fig. [3] we assess the impact of the rank r on the output 
signal-to-interference-plus-noise ratio (SINR) performance of 
the proposed and existing algorithms. There are q = 25 
users in the system whose DoAs are generated with uniform 
random variables between and 180 degrees. The input SNR 
is SNR=10 dB. In order to show the convergence behavior, 
we set the total number of snapshots to N = 300. The value 
of the rank r is chosen between 1 and 10 because reduced- 
rank adaptive algorithms usually show the best performance 
for these values lfl2l . ||3T1 . A reduced-rank algorithm with 
a lower rank (e.g., r — 3) often converges quickly whereas 
a reduced-rank technique with a larger rank (e.g., r = 8) 
reaches a higher SINR level at steady state. We have chosen 
the parameters a = 22, /3 = 0.99, fir(l) = /ito(l) = 0.05 for 
the proposed JIO-SM-SG algorithm, and a = 26, = 0.992, 
p = 1.3 x 10~ 3 , q = 1.0 x 10~ 4 for the proposed JIO-SM- 
RLS algorithm in order to optimize the performance of the 
algorithms. By changing these parameters, the performance 
will be degraded, the update rate will decrease if the threshold 
5 is large, whereas the update rate will increase if the threshold 
5 is small. Note that Ai(i) should be in accordance with the 
setting of the forgetting factor and thus 0.1 < Ai(i) < 0.998 
is used for implementation. Fig. |3] suggests that the most 
adequate rank for the proposed algorithms to obtain the best 
performance in this example is r — 5, which is equal to or 
lower in comparison to the existing reduced-rank algorithms. 
Besides, we also checked that this rank value is rather insen- 
sitive to the number of users or interferers in the system, to 
the number of sensor elements, and work efficiently for the 
scenarios considered in the next examples. Since the best r is 
usually much smaller than the number of elements m, it leads 
to a significant computational reduction. In general, we may 
expect some variations for the optimal rank r which should 
be in the range 3 < r < 10. In the following simulations, we 
use r = 5 for the proposed algorithms. 

In Fig.|U we evaluate the SINR performance of the proposed 
and existing algorithms versus the number of snapshots. It 
includes two experiments, which compare the SG-based and 
the RLS-based algorithms. The AVF algorithm is included in 
both experiments to make a clear comparison. The scenario 
and the coefficients for the proposed algorithms are the same 
as in Fig. [3] The number of snapshots is N = 1000. In Fig. 
|4] (a), the JlO-based algorithms show a better convergence 
rate than other full-rank and reduced-rank algorithms. The 
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Fig. 3. Output SINR versus the number of rank r. 



proposed JIO-SM-SG algorithm has a good performance and 
only requires 17.2% updates (172 updates for 1000 snapshots), 
reducing the computational cost. Fig. |4] (b) exhibits a sim- 
ilar result for the RLS-based algorithms. The JIO-SM-RLS 
converges quickly to the steady-state, which is close to the 
minimum variance distortionless response (MVDR) solution 
0. The update rate is r = 14.2%, which is much lower than 
its reduced-rank counterparts that require 100% updates. 




500 

(a) Number of Snapshots 



1000 



500 1000 
(b) Number of Snapshots 



Fig. 4. Output SINR versus the number of snapshots for (a) SG-based 
algorithms; (b) RLS-based algorithms. 

Fig. [5] shows the SINR performance of the proposed algo- 
rithms with the fixed and time- varying bounds. The scenario 
is the same as that in Fig. [3] From Fig. [5] (a), we find that 
the curve with the fixed bound S = 1.0 has comparable 
SINR values to the proposed one as the number of snapshots 
increases. The reason is that we use the BPSK modulation 
scheme and thus the absolute value of the ideal array output 
should equal 1, which follows the constraint and achieves high 
SINR values. However, it requires more updates (t = 44.8%) 
and has to afford a much higher computational load. The 
curves with higher (S = 1.4) or lower (S = 0.8) bounds ex- 



hibit the worse convergence performance. The proposed JIO- 
SM-SG algorithm with the time-varying bound performs the 
data-selective updates to obtain a good tradeoff between the 
complexity and the performance. The same result can be found 
in Fig. |5](b) for the proposed JIO-SM-RLS algorithm, which 
uses even less updates to obtain an enhanced performance. 






JIO-SM-SG 


— ©- 


(1=17.2%) 




S = 0.8 


— B- 


(1=17.5%) 




8 = 1.0 


— 0- 


(t =44.8%) 
8= 1.4 


(t =71 .6%) 



500 1000 
(a) Number of Snapshots 




500 1000 
(b) Number of Snapshots 



Fig. 5. Output SINR versus the number of snapshots for (a) SG-based 
algorithms; (b) RLS-based algorithms. 

In the next experiment, we consider a non-stationary sce- 
nario, namely, when the number of users changes in the 
system, and check the tracking performance of the proposed 
algorithms. The system starts with q = 20 users including 
one desired user. The coefficients are r = 5, a = 18, 
(3 = 0.99, n T (l) = ^(1) = 0.05 for the proposed JIO-SM- 
SG algorithm and r = 5, a = 19, /3 = 0.995, p = 1.3 x 10" 3 , 
q = 1 x 10~ 4 for the proposed JIO-SM-RLS algorithm. 
From Fig. [6] the proposed algorithms achieve a superior 
convergence performance to the other compared algorithms. 
The environment experiences a sudden change at i = 1500. We 
have 10 interferers entering the system. This change degrades 
the SINR performance for all the algorithms. The proposed 
algorithms track this change and converge rapidly to the 
steady-state since the data-selective updates reduce the number 
of parameter estimation and thus keep a faster convergence 
rate. Besides, the time-varying bound provides information for 
them to follow the changes of the scenario. It is clear that the 
proposed algorithms still keep low update rates (r = 15.3% 
for the JIO-SM-SG and t = 16.0% for the JIO-SM-RLS even 
under non-stationary conditions. 

In the last experiment, the simulated and analytical results 
in Subsection V-C for the proposed JIO-SM-SG algorithm are 
compared. The simulated curves are obtained via simulations 
in Fig.|7]and the predicted ones are from (|36V In this scenario, 
there are q = 20 users in the system and INR= 25 dB. 
We compare the results with two different SNR values, i.e., 
SNR= 5 dB and SNR= 10 dB. The coefficients are a = 9.7, 
/3 = 0.99, /Lt T (l) = /iffi(l) = 0.05, and r = 5. To get the 
predicted MSE, we set P min = 17.0% (for SNR=5 dB) and 
-Fmin = 16.3% (for SNR=10 dB), which are in accordance 
with the update rates of the simulated MSE and provide a fair 
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M=64; q 1= 20; q 2 = 30; SNR=10 dB; INR=30 dB 




1000 1500 2000 
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Fig. 6. Output SINR versus the number of snapshots in dynamic scenario 
with additional users enter and/or leave the system. 



comparison. From Fig. [7] the predicted curves agree with the 
simulated ones, especially when i > 200, verifying the validity 
of our analysis. Note that there is a small gap between the 
simulated and predicted curves at the beginning. The reason 
is that the number of snapshots is insufficient for the proposed 
JIO-SM-SG algorithm to provide accurate estimates if i < m 
(or before the algorithm converges to the steady-state). The 
update rates for the simulated curves are quite low and thus 
decrease the computational cost for the proposed algorithm. 




400 600 
Number of Snapshots 



1000 



Fig. 7. MSE performance versus the number of snapshots for the proposed 
JIO-SM-SG algorithm. 



VII. Concluding Remarks 

We have introduced a new reduced-rank framework that 
incorporates the SMF technique into the reduced-rank JIO 
scheme for beamforming. According to this framework, we 
have considered reduced-rank LCMV designs with a bounded 
constraint on the amplitude of the array output, and developed 
SG-based and RLS-based adaptive algorithms for beamform- 
ing. The proposed algorithms have employed the received data 



to construct a space of feasible solutions for the updates. 
They have a superior convergence and an enhanced track- 
ing performance over their existing counterparts due to the 
iterative exchange of information between the transformation 
matrix and the reduced-rank weight vector. In addition, the 
proposed algorithms can save computational costs due to the 
data-selective updates. A time-varying bound was employed to 
adjust the step size values for the SG-based algorithm and the 
forgetting factor values for the RLS-based algorithm, making 
the proposed algorithms more robust to dynamic scenarios. 
The results have shown the advantages of the proposed algo- 
rithms and verified the analytical formulas derived. 

Appendix 

Derivation of JIO-SG Algorithm 

The recursions for the JIO-SG algorithms are derived from 
(TTOb . Fixing w and computing the gradient terms of (fTOl with 
respect to T r and using a gradient descent rule [?], we have 

T r [i + 1] = T r [i] - ii T {y*[i\x\i]w H [i\ + 27 1 a(9 )w H [i]). 

(43) 

Substituting the above into the constraint w H [i]T r [i]a(9o) = 
7, we obtain the value of the Lagrange multiplier 



r) = l/2(a H (0o)a(d Q ))- 1 a H (8 o )x[i}y*\i} 



(44) 



Substituting ?/ into d43l . we obtain ( fTTT ). The recursion for w 
is obtained by an analogous gradient descent rule 

w[i + l] = w\i]-fi w (y*\i]T?\i]x\i}+2r]T?\i]a(9 )). (45) 

Using the constraint again with the above recursion, we can 
obtain the value for the Lagrange multiplier for use in the 
update of w and which results in ( fT~3T >. 



Derivation of Variable Step Size Values 

In this appendix, we derive the expressions in (fTTt and 
(fT4l) . We drop the time instant i for simplicity. According to 
the optimization problem, substituting (fTTT i into the bounded 
constraint in (0, we have 



: H a(9 )a H (9 )]y 



8 (46) 



The above equation can be expressed in an alternative form, 
which is 



y - ii* T yw H wx H [I - a(6 )a H (6 )] x 



= 5 



(47) 



Making an arrangement to (l47t . we obtain the variable step 
size expression for the transformation matrix in (Q~3}. 

Also, substituting (fT2l into the bounded constraint, we 
obtain 



w H x 



a(9 )d H (9 ) 
a H (6 )d(8 ) 



x 



= S, 



(48) 



where the expression of /x^ in ( fT~4-b can be obtained by 
performing mathematical transformations to (148V 
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Derivation of (fT6l ) 

In this appendix, we derive the expression of the transfor- 
mation matrix in (fTol l. Given w(i) ^ 0, taking the gradient of 
(JT3J with respect to T r (i), we have 

i-l 

VJ Tr(l) = ^\\- l (i)x(l)x H (l)T r (i)w(i)w H (i) 
1=1 

+ \i(i)x(i)x H \i)T r (i)w(i)w H ' (i) + X 2 a(9 )w H (i) 

(49) 

Making VJr r (i) = and right-multiplying the both sides 
by w(i), and rearranging the expression, it becomes 

i-l 

T r (i)w(i) = -A 2 [^Ar i (i)a:(Z)x J? (Z)-|-Ai(i)a;(i)a! fr (i)] _1 a(6'o). 

!=1 

(50) 

Considering the assumption Ai(i) — > 1 and using the matrix 
inversion lemma, we have 

T r (i)w(i) = -\ 2 [R(i - 1) + X 1 (i)x(i)x H (i)f 1 a(e Q ) 
= -\ 2 P(i)a(6 ), 

(51) 

where P(i) has been given in (fl~8T >. 

Let v(i) = P(i)a(8o), the solution of T r (i) can be 
regarded to find the solution to the linear equation 



T r (i)w(i) = v(i), 



(52) 



where there exists multiple T r (i) satisfying this equation if 
only w ^ 0. We derive the minimum Frobenius-norm solution 
for stability. We write T r (i) and v(i) in the form of 



T r (i) 



*a(0 
imii) 



v(i) 



V2(i) 

v m (i) 



(53) 



where G 



with j = 1 , . . . , m denotes the row vector of 



the transformation matrix. Thus, the search of the minimum 
Frobenius-norm solution is simplified to the following m 
subproblems: 

minimize || 2 , subject to tj(i)w(i) = vj(i). (54) 



Solving the constrained optimization problem in (l54h we 
have 

w H (i) 

Substituting (IB3T l into d52b and considering the definition of 
v(i), the minimum Frobenius-norm solution is given by 

w H {i) 



T r (i) = -\ 2 P(i)a(6 )- 



(56) 



\\w(i)\\ 2 

where A2 can be obtained by incorporating ( IBTt into the 
constraint with respect to a(6o), which is 



A- 
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aH(6 )P(i)a{6 y 



(57) 
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